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Abstract 

We propose a inexact Newton method for solving inverse eigenvalue problems (lEP). This 
method is globalized by employing the classical backtracking techniques. A global convergence 
analysis of this method is provided and the R-order convergence property is proved under some 
mild assumptions. Numerical examples demonstrate that the proposed method is very effective 
for solving the lEP with distinct eigenvalues. 
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^ : 1 Introduction 

en 



In the present paper, we consider inverse eigenvalue problems (lEP) which are defined as fohows. 
Let c = (ci, C2, . . . , Cn) S K" and {^i}"=o '-'^ ^ sequence of real symmetric n x n matrices. Define 

n 

Aic) = Ao + Y,CiAi (LI) 

and denote its eigenvalues by {Xi{c)}f^^ with the increasing order Ai(c) < A2(c) < ••• < A„(c). 
Given n real numbers {A*}"^^ which are arranged in increasing order A^ < A2 < • • • < A* , the lEP 
is to find a vector c* G M" such that 

Ai(c*) = A:, i = l,2,...,n. (1.2) 

Such vector c* is called a solution of the lEP. This type of inverse problem arises in a variety of 
applications, for instance, the inverse Toeplitz eigenvalue problem |10y20j. inverse Sturm-Liouville's 
problem, inverse vibrating string problem and the pole assignment problem, see [6HH] and the 
references therein for more details on these applications. 
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Define / : M" ^ M" by 

/(c) = (Ai(c) - \l, A2(c) - A*2, . . . , A„(c) - A:)^. (1.3) 

Then, solving lEP (jl.2p is equivalent to solving the nonlinear equation /(c) = on R". It is clear 
that, c* is a solution of the lEP if and only if c* is a solution of the equation /(c) = 0. Based on 
this equivalence, Newton's method can be applied to the lEP, and it converges quadratically [14J. 
As it is known, each iteration of Newton's method involves solving a complete eigenproblem for 
the matrix A{c). To overcome this drawback, different Newton-like methods have been proposed 
and studied |14il5j. To alleviate the over-solving problem, Bai, Chan and Morini presented in [Ij 
an inexact Cay ley transform method for solving the nonlinear system /(c) = 0. To avoid the 
computation of the approximate Jacobian equations, Shen and Li proposed in |161ll7j Ulm-like 
methods for solving the lEPs. However, all these numerical methods for solving the lEP converge 
only locally. 

In this paper, we study the numerical methods with global convergence property for solving 
the lEP. Since the lEP is a nonlinear equation, we review some classical work on solving the 
general nonlinear equation /(c) = 0. Among the inexact Newton-type methods where a line-search 
procedure is used, an inexact Newton backtracking method was proposed in [11]. It performed 
backtracking along the inexact Newton step, and computational results on a large set of test 
problems have shown its robustness and efficiency |12yi5j. 

The purpose of the present paper is, motivated by the inexact Newton backtracking method 
proposed in [11], to propose an inexact Newton-type method which combines with the Cayley 
transform method for solving the lEP. Under the classical assumption, which is also used in plHlllG) . 
that the given eigenvalues are distinct and the Jacobian matrix J(c*) is invertible, we show that 
this method is global convergent. To further improve the feasibility, we also propose a hybrid 
method for solving the lEP by using a simpler condition in the backtracking loop. Some numerical 
examples are reported to illustrate the effectiveness of the proposed hybrid method with distinct 
eigenvalues. 

The paper is organized as follows. In Section 2, a global inexact Newton-type algorithm is 
proposed. The global convergence analysis is given in Section 3. In Section 4, we present a hybrid 
algorithm for solving the lEP. And finally in Section 5, some numerical examples are given to 
confirm the numerical effectiveness and the good performance of our algorithm. 

2 A Global Inexact Newton- Type Method 

In this section, we present our algorithm. Let M"^" denote the set of all real n x n matrices. 
Let II • II and || • \\f denote the 2-norm and the Frobenius norm in M", respectively. The induced 
2-norm in M"^" is also denoted by || • ||, i.e., 

\\A\\:= sup \-^, ^eM'^^". 
xeM",X7^0 ll^ll 

Then, we have ||^|| < ||^||f for any A G M"^". Let Ai(c) < A2(c) < • • • < A„(c) be the eigenvalues 
of matrix ^(c), and let {qi(c)}"^j^ be the normalized eigenvectors corresponding to {Ai(c)}"^^. 
Define J(c) = ([J(c)],,) by 

[J(c)]i,- := q,(c)T^jq,(c), l<i,j<n. (2.1) 



Let {A*}f=i be given with A^ < A^ < • • • < A^ and write A* = (A^, A^, . . . , A^)"^. 

The Cayley transform method for computing approximately the eigenproblem of the matrix 
A{c) was proposed in [T3] and was apphed in [HfTB]. We now recaU this method and then apply it 
to our algorithm. Suppose that c* is a solution of the lEP. Then, there exists an orthogonal matrix 
Q=K such that 

QjA{c*)Q, = diag{A^ A*2, . . . , A^} ^ A*. (2.2) 

Assume that c,p and P are the current approximations of c*,A* and Q=k, respectively. Define 
e := P Q^:, where y is a skew-symmetric matrix. Then, (j2.2p can be rewritten as: 

P^^(c*)P = e^A*e-^ 

= (I + Y + ^Y^ + ■ ■ ■)A*{I -Y + ^Y^ + ■ ■ ■) 

= A* + YA*-A*Y + 0{\\Yf). (2.3) 

Based on (|2.3p . we define the new approximation c^^"^ of c* by neglecting the second-order terms 
inY: 

pT^^^ncw^p = A* + YA* - A*Y. (2.4) 

By equating the diagonal elements in (j2.4p . we have 

A* = Pi(c)TA(c--)p,(c), i = l,2,...,n, 

where {Pi{c)}f^i are the column vectors of P. Thus, once we get c'-^^'" by solving the Jacobian 
equation, we can obtain Y by equating the off^-diagonal elements in (|2.4p . i.e., 

p,(c)^A(c^-)p^.(c) ^ ^ . , . ^ ,„ ,, 

In order to update the new approximation P'^'^™ of Q^:, we construct an orthogonal matrix U 
using Cayley's transform 

C/:=(I+iy)(I-iy)"' (2.6) 

and set P^''™ = PU, that is, we can obtain P"'^"" by solving 

(I + iy)P'^^™ = (I - -Y)P. (2.7) 

Finally, the new approximations of eigenvalues can be obtained by 

p-" := P,(c-")^A(c-")p,(c"™), z = 1,2, . . . ,n, (2.8) 

where {Pi{c'^^'")}^=i are the column vectors of p^^"". 

Note that, (|2.7p can be computed as follows. Compute H := {I — ^Y)P^ and let hj be the ith 
column of H at first. Then, solve Wj, z = 1, 2, . . . , n, iteratively from the n linear systems: 

(/ + ly)wi = h„ i = l,2,...,n. (2.9) 

Finally, set P^*^"" ;= [wi, . . . ,Wn\ ■ Since P is an orthogonal matrix and Y is skew-symmetric 
matrix, we see that P'^'^™ must be orthogonal. To maintain the orthogonality of P'^'=^™, (j2.9p cannot 



be solved inexactly. One could expect that it requires only few iterations to solve each system of 
(j2.9p . This is due to the fact that, as {c^} converges to c*, ||yfc|| converges to zero, see [HI eq. 
(3.64)]. Consequently, the coefficient matrix on the left-hand side of (|2.9p approaches the identity 
matrix in the limit. 

For solving the general nonlinear equation /(x) = 0, linesearch techniques [S] are often used 
to enlarge the convergence basin of a locally convergent method. They are based on a globally 
convergent method for a problem of the form min M(x), where M is an appropriately chosen 

merit function whose global minimum is a zero of /. In these cases, for a given direction s G M", 
we have the iteration form x^+i = x^ + as, where a G (0, 1] is such that M(xfc + as) < M(xfc). 
The existence of such an a is ensured if there exists an oq > such that M(xfc + as) < M(xjt) for 
all a < aQ. 

In typical linesearch strategies, the step length a is chosen by using so-called backtracking 
approach. Among the backtracking method, inexact Newton backtracking method (INB) [TT] is 
a globally convergent process where the fcth iteration of an inexact Newton method is embedded 
in a backtracking strategy. The merit function M of INB is usually used M := ||/||, see for 
example [3l llll[T2t ll5j. Thanks to (jl.3p . this will involve computing Aj(c^) of ^(c'^) which are costly 
to compute. Our intention here is to replace them by the Rayleigh quotient (see (j2.8j) ). In Section 
3 we will show that this replacement retain superlinear and global convergence. 

The details of our algorithm for solving the lEP are specified as Algorithm 12.11 In step 7, the 
following sufficient decrease in the merit function ||p(c) — A*|| based on the Rayleigh quotient is 
provided: 

\\p{c^ + Ac'^) - A*|| < (1 - e(l - %))||p(c'=) - A*||. 

The while loop in step 7 is also called backtracking loop below. 

3 Convergence Analysis 

In this section, we analyze the global behavior of Algorithm 12.11 We will show that if the 
given eigenvalues are distinct and if there exists an accumulation point c* of {c'^} such that the 
Jacobian matrix J(c*) is invertible, then the iterations are guaranteed to remain near c* and 
p(c*) — A* = 0, c'^ — 7- c* as fe — )• cx). Furthermore, for k sufficiently large, we have the equality 
c "''^ = c + Ac . Thus, we obtain that the ultimate rate of convergence is /? which depends on the 
choices of the % given in (|2.14p . 

It is worth noting that, if {c } has no accumulation point, or {c } has one or more accumulation 
points and the Jacobian matrix is singular at each of them, or the vector Ac computed by solving 
the Jacobian equation (j2.12p is such that Ac'^ = 0, then our algorithm fails. 

It is clear that, if p{c^) — A* — )• as /c — )• oo and c* is an accumulation point of {c'^}, then 
p(c*) — A* = 0. Let {-Pfc} be generated by Algorithm 12.11 (see step 7) and define Ek := Pk — Q* for 
each k = 0,1, . . .. The following lemma is taken from [2*, Lamma 2]. 

Lemma 3.1 ( [2j). For any c,c G M", we have 

\\Aic)-A{c)\\<L\\c-c\\, 

where L := {^^^\\Ai\\^)K 

Based on Lemma l3.lt the following lemma is a straightforward application of [1^ Lemma 4]. 



Algorithm 2.1: Inexact Newton Backtracking Cayley Transform Method for lEP 

For any c*^ G ^^,r]ma.x £ [0, 1),^ G (0, 1),0 < 9min < (^max < 1- Compute the orthonormal 
eigenvectors {qj(c'^)}"=i and the eigenvalues {\i{c^)}f^i of ^(c*^). Let 

Po := [pi(cO),P2(cO),...,p„(cO)] = [qi(c0),q2(c0),...,q„(c0)], (2.10) 

p(cO):=[pi(cO),p2(c°),...,/>„(c°)r = [Ai(cO),A2(cO),...,A„(cO)]^. (2.11) 

For A; = 0, 1, 2, . . . until convergence do: 

step 1. Form [Jk]ij = Pi(c'^) Ajp^{c'') for I < i,j < n. 

step 2. Solve Ac inexactly from the approximate Jacobian equation: 

JfcAc'^ + p(c'=) - A* = (2.12) 

such that 

II JfcAc'^ + p(c'=) - A*|| < %||p(c'=) - A*||, (2.13) 

where 779 G (0, 1) and 

r?fc:=min "^\|(,||. " , ||"Vfc-n ^>^max , /3 G (1, 2], /c = 1, 2, . . . . (2.14) 

I ||A ||p IIpIC^ ) ~ a ||p J 

step 3. Set Ac'^ = Ac'^ and ijk = %• 

step 4. Form the skew-symmetric matrix Y^ by (12. 5p with c^'^" = c + Ac . 

step 5. Compute matrix Pj. := [pi(c^ + Ac'^), . . . , p„(c^ + Ac'^')] by solving (j2.7p . 

step 6. Compute p(c'= + Ac^) = (pi(c'= + Ac'^), . . . , pn{c^ + Ac'^))^ by ^M)- 

step 7. While ||p(c^ + Ac*-') - A*|| > (1 - ^(1 - r?fc))||p(c'=) - A*|| do: 

choose 9 G [^min, ^max], then update Ac'^ ^ ^Ac'^' and % ^ 1 — ^(1 — r/^). 

step 8. Set c'^+^ = c'^ + Ac*^. As steps 4-6, compute, respectively, the new approximations 

Pfc+i := [pi(c'=+i),...,pjc'=+i)] and p(c^+i) := {p^{c'^+% . . . , p^{^+^)f . 



Lemma 3.2. Assume that c* is an accumulation point of {c }. Let the given eigenvalues {A*}^^;^ 
be distinct. Then 

\\p{c'')-\*\\<V^L\\c''-c*\\+fi2\\Ekl 

for any k £N, where ^2 := 2-y/n • ||A(c*)||. 

As shown in [191 Thoerem 2.3], in the case when the given eigenvalues {A*}^]^ are distinct, the 
eigenvalues of A{c) are distinct too for any point c in some neighborhood of c*. It follows that the 
function /(•) defined in (jl.3p is analytic in the same neighborhood. However, if c is not near the 
solution c*, the analyticity of the function /(•) cannot be guaranteed. 

For any symmetric matrix X G M"^", set A{X) := diag(Ai(X), . . . , Xn{X)), where Xi{X),i = 
1, 2, . . . , n, are the eigenvalues of X. As proved by Sun and Sun [181 Theorem 4.7], A(-) is a strongly 
semismooth function. Based on this result, for any c G M" and e > 0, there exists 5 > sufficiently 
small such that 

||p(c) — p(c) — J(c)(c — c)|| < e||c — c|p, for any c G B(c,(5). 

The following lemma says that, the backtracking loop in step 7 of Algorithm 12.11 terminates 
after a finite number of steps. 

Lemma 3.3. There exists r/™™ G [0) 1) such that, for any rj^ G [??™™, 1), there is Ac*^ satisfying 

||p(c^ + Ac'^)-A*||<[l-e(l-%)]||p(c^-)-A1|. 

Proof. By using the strong semismoothness of all eigenvalues of a real symmetric matrix p!8j, for 
any given e > 0, there exists 6 > sufficiently small such that 

||p(c^' + Ac) - p(c*^) - JfcAcll < e|| Ac|| (3.1) 

whenever ||Ac|| < 6. Choose 

_ (l-^)(l-r?,)||p(c'=)-A*|| 



I Ac 






(3.2) 



and set 



r?r:=max^%,l-il^^|. (3.3) 



For any rjk G [r/™™, 1), let Ac := j^^Ac . Then, by the definition of 7?™™ given in (|3.3|) . we have 

Ac" = i^ Ac" < ^ Ac" < -^ 3^ ^ Ac" = S. 

1-% 1-% ||Ac"|| l-Vk 

On the other hand, by ()2.13p . one gets that 

||p(c") - A* + JfeAc"|| < "^^ ~3 IIp(c^) - A*|| + i:i^||p(c") - A* + JfcAc"|| 

1 - ^fc 1 - ^fc 

< ^P^llp(c'=) - A*|| + i^ •%,||p(c") - A*|| 
= %||p(c")-A*||. 
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This together with I^Jj) and ^2^ yields that 

||p(c'^ + Ac'^) - A*|| < ||p(c'= + Ac'^) - p(c'=) - JfcAc'^ll + ||p(c'=) - A* + JfcAc'^|| 

< e||Ac''|| +r]k\\p{c^) - X*\\ 

= ei^||Ac'=||+r?fc||p(c'=)-A*|| 

= (1 - e)(i - vk)\\pic'') - A*|| + mWpic") - x*\\ 

= [i-e(i-%)]iip(c^)-A*ii, 

and the proof is completed. D 

Next, we give sufficient conditions for Algorithm 12. II not to break down in the backtracking loop 
in step 7. 

Lemma 3.4. // p(c ) — A* 7^ and there exists F > for which 

||Ac'=||<r(l-%)||p(c^')-A1|, (3.4) 

then, the backtracking loop terminates. 

Proof. For constant F in (j3.4p and the given ^ G (0,1), choosing e = -^, there exists 6 > 
sufficiently small such that ()3.ip holds whenever ||Ac|| < 6. We choose r]k G [rj^, 1] satisfying 

It follows that 

||Ac'=||<F(l-%)||p(c^')-A*||<c^, 

which gives c^ + Ac*^ G B(c'^', 5). Thus, we have 

||p(c + Ac'^) - p(c'=) - JfcAc'^ll < i^||Ac'=||. 

This together with (I2.13P gives that 

||p(c'= + Ac'^) - A*|| < ||p(c'=) - A* + JfeAc'^ll + ||p(c^ + Ac^) - p(c^) - JfcAc'^H 

< %||p(c^') - A*|| + (1 - 0(1 - m)\\p{c') - X*\\ 
= (l-e(l-%))||p(c'=)-A*||. 

It follows that the backtracking loop terminates. This completes the proof. D 

The next lemma gives condition under which ()3.4p is satisfied. 



Lemma 3.5. Assume that the Jacobian matrix Jk is invertible and set Mj^ := \\Jj^ \\. Then there 
exists F such that (13.41) holds. 



Proof. By using condition (j2.13p . one has that 

IIAr'^ll < II 7^^1111 /, Ar^ll 

< MkiMc'^) - A* II + llp(c^) - A* + J.Ac'^ll) 
<Mfc(l + %)||p(c'=)-A*|| 

= M,i±^(l-r?,)||p(c'=)-A*|| 
1 -% 

<M,i±^^(l-r?,)||p(c'=)-A*||. 

J- ^max 

We finish the proof by taking T := Mfcii^max . □ 

Lemmas 13.41 and 13.51 yield the result below. 

Corollary 3.1. Assume that p{c ) — A* 7^ and J^ is invertible. Set M^ := || J^ || and T := 

Mfc j^_^'"°''' . Then, the backtracking loop in step 6 of Alaorithm Yl.W terminates with 



l-r/.>min|l-ry„^^^^-^p^j (3-6) 

for any 5 > G small enough such that ()3.ip holds whenever ||Ac|| < 5. 

Proof. Suppose that rjk is the final value determined by the while-loop. If rjk = rjj^, then (13. 6j) is 
trivial. Assume that r]k 7^ %) that is, the body of the while-loop has been executed at least once. 
Denoting the penultimate value by 77^, then it follows from (13. 5p that 1 — r/^ > ril (cfe'i-A*!! " '^^^^j 
we have 

l-ri, = e{l- r?-) > e^^{l -rj-)> f.f . 

-■- IIPl^ j — A II 

This completes the proof. D 

Lemma 3.6. Assume that c* is an accumulation point of {c } such that there exists a constant F 
independent of k for which 

||Ac'=||<r(l-ryfc)||p(c^')-A1|, (3.7) 

whenever c is sufficiently near c* and k is sufficient large. Then c — )• c* as k ^ 00. 

Proof. Suppose that c'^ -^ c*. Then, there exists 6 > sufficiently small such that there are 
infinitely many k for which c B (c* , 6) and (\3.7h holds whenever c G B (c* , 6) for k sufficiently 
large. 

Since c* is an accumulation point of {c }, there exists subsequence {c^} C {c } such that 
f.ki g B(c*, J/i) for i sufficiently large. Choose (i > satisfying ki+ii < /cj+i and c^'+^» B(c*, (5). 
It follows that 

||p(c'^.+.-i) _ A*|| < — i (||p(c'='+^-i) - A*|| - ||p(c'=»+^') - A*||) , j = l,...,i^. 

r(i - vh+j-i) ^ ) 



Then, by ()3.7p . we have, for i sufficiently large, 

l<\\c''^+e._c^^\\< Y^ IIAc'^ll < Y2 r(l-%)||p(c'=) 
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Note that c'^' — ^ c* as i — > oo. It follows that \\p{c'^^) — A*|| — ||p(c'^*+i) — A*|| — ^ 0, which is a 
contradiction. Therefore, c — )• c* as A; — )• oo. D 

Lemma 3.7. Assume that c* is an accumulation point of {c''} such that J(c*) is invertible. Set 
M = II J(c*)~ II and let 6i be such that < ^i < jim' ""'^^'^6 Mi •= 2n • max ||Aj||. Suppose that 

ll-E'fcll ^ ^1 for k sufficiently large. Then, for all k sufficiently large, 

" ' "- i-m«i||J(cT'|| - 

Proof. By the definitions of [Jk]ij and [.J{c*)]ij, for all k sufficiently large, 

\[Jkh - [Ac*)U < Ip.ic'^f Ajp.ic'') - p,(c^')''^,q,(c*)| + |p,(c^')^^,q,(c*) - q,(c*)TA,-q,(c*)| 

l,||||p,(c'=) - q,(c*)|| + ||p,(c'=)^ - q,(c*)"^||P,| 



<||p,(c'=)^||P,||||p,(c'=)-q,(c*)|| + ||p,(c'=)^-q,(c*)"^||P,||||q,(c*) 



= 2P,-||||p,(c'^)-q,(c*)||, l<i,j<n. 
Then, we have, for all k sufficiently large, 

II Jfc - J(c*)|| < II Jfc - J(c*)||f < 2n ■ max \\Aj\\ ■ max \\Pi{c'') - q,(c*)||. 

Noting that, Pj(c'^) — qj(c*) is the ith column of E^, then ||pj(c'^) — qj(c*)|| < \\Ef^\\ for z = 1, . . . ,n. 
So, for all k sufficiently large, 

||J(c*)-i||||Jfc - J(c*)|| < fii6iM <l<l. 

It follows from Banach lemma that Jk is invertible and ||J^ || < 2M for all k sufficiently large. 
This completes the proof. D 

Lemmas 13.51 13.61 and 13.71 yield the result below. 

Corollary 3.2. Assume that c* is an accumulation point of {c } such that J(c*) is invertible. Set 
M := II J(c*)^ II and let 5i be determined by Lemma \3.7[ Assume that H-EfcH < Si for k sufficiently 
large. Then c'^ — )• c* as A: —)• oo. 

Proof. By Lemma 13.71 we know J^ is invertible and || J^ || < 2M for all k sufficiently large. From 
the proof of Lemma 13.51 (13.71) holds for the constant F = 2M-. — "^hns^ independent of k. Therefore, 
c'^ — 7- c* as A; — 7- OO follows from Lemma 13.61 D 

Corollary 3.3. Assume that c* is an accumulation point of {c } such that J{c*) is invertible. 
Then, p{c^) — X* — )• as k ^ oo. Moreover, for all k sufficiently large, we have rjk = rik- 

Proof. If Ac'^ is computed in the backtracking loop, the backtracking terminates with 7]^ such that 
p.6p holds. Since c — )■ c* by Corollary 13. 2^ we have c G B(c*, 6) for all k sufficiently large. Thus, 
the series X]fclo(^ ~ ^k) is divergent. Then, we have 

Yl [l-^{l-Vi)]< n e-«(^-''')=e"^'£^^"'''^^0, A^oo, 

l<j<fc l<i<fc 



and so, 



|p(c'=)-A*||<[l-e(l-%_i)]||p(c'=-i)-A*||<||p(cO)-A*||. J] [l-e(l-7?,)]^0, A:^oo. 



0<i<k 



This together with (|3.6p yields that t?^ = rjj^ for ah A; sufficiently large. 



D 



Lemma 3.8. Assume that c* is an accumulation point of {c^} such that J{c*) is invertible. Then, 
there exists ^2 > such that 



\\p{c'') - X* - J,{c'' - c*)\\ < f^3\\Ekfp 
whenever c^ G B(c*,(52) and k sufficiently large, where fi-^ := 2 max |A^|. 

l<i<n 

Proof. Set Hk := Q{c*) Pk — I. Then, we have, for all k sufficiently large, 

Pj!A{c*)Pk = (I + HkfA*{I + Hk) = A* + A*Hk + hJ A* + HjA*Hk. 
It follows that, for all k sufficiently large, 

n 

p,{c'f A{c*)p,{c') = A* + 2X*[H,]u + Y,Wk]lr ^ = 1,2, . . . ,n. 



Set 



Jy 



i = 1,2,... ,n. 



and write v = {vi,V2, ■ ■ ■ , Vn) ■ It follows that J^c* = A* — a'^ + v, where 

[a1* = p,(c'=)^AoPi(c'=), 2 = 1, 2, . . . , n. 
In view of that J^c^ = p{c^) — sJ' for any /c G N, one has that, for all k sufficiently large. 



V = p(c^-) - A* - Jk{c' 



Since 
we have 



Td dT, 



I + HkH^ + HkHil = (I + Hk)il + Hk)' = Q(c*) ' P^P^ Q{c 



[H, 



k\ii 



1 "^ 



i = 1,2, . . . ,n. 



j=i 



It follows from (j3.9p that, for all k sufficiently large 

2 
/ " \ 

,2 



V,- 



2Ani/fck + j;A*[/?4| <2 



4(A:)2[Ffc]|+| j;A*[i/, 



fcjjj 



Combining (j3.1ip with (j3.12p . one has that, for all k sufficiently large. 



E^'^2 



i=l 



n I n 






k\ij 



i=l 



(3. 



(3.9) 



(3.10) 



(3.11) 



(3.12) 



10 



n I n 






<2 



i=l 



max 

l<i<n 



2 / \ 2- 

n I n \ n I n 

l<i<n' ' ' ^-^ \ ^-'^ ■ -^ 
«=1 \J=1 / «=1 \i=i 



lAiPE EMI +,">Ki^<i'E E™= 



= 4 max I All • ||-fri.|| c 



k\ij 



\<i<n 



which gives 



Note that, 



k\\Fi 



|v|| < 2 max |A*| • ||-fffc||p. 

\<i<n 



\\R^\\f = ||Q(C*) ' Pk - \\\f = llPfc - Q(c*)||f = \\Ey,\\F. 

Therefore, we obtain from ()3.10p that (13.8P holds for all k sufficiently large. This completes the 
proof. D 

Lemma 3.9. Assume that c* is an accumulation point of {c } such that J(c*) is invertible. Then, 
there exist 63 > 0,(54 G (0,(5i] sufficiently small such that \\Ek\\ < 64 and 



2 \ 



/3 



||c^+i - c*|| < 2M UsWEkfp + i^-j ||p(c'=) - A*f j 
whenever c £ B(c*,(53) and k sufficiently large, where 61 is determined by Lemma \3.7[ 



(3.13) 



Proof. Thanks to Corollary 13. 3| we have rjk = r]^ ^-ii'i ^^ = ^^ fo'^ ^^ ^ sufficiently large. Thus, 
the Jacobian equation (j2.12p is equivalent to, for all k sufficiently large, 

Jfec'^+i - A* + a^^ = 0. 

Assume that the residual of this approximate Jacobian equation is defined by r^, i.e., for all k 
sufficiently large, 

r'^ = Jfcc'^+i - A* + a^ 

This together with J^c* — A* + a = v gives, for all k sufficiently large, 

Jfc(c* - c'^+i) = V - r^ 
By (j2.13p . Lemmas 13.71 and 13.81 we obtain, for all k sufficiently large, 

||c'=+i-c*||<||J-i||(||v|| + ||r'=||) 

<2ML3iii^feiii+ "^^" -;'' 

It follows from Lemma 13.21 that 

||p(c'') - A*|| < yJnL\\c^ - c*|| + ^l2\\Ekt V A; G N. 
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Thus, we can choose ^3 > and < 84 < 61 sufficiently small such that 

whenever Hc'^ — c*|| < ^3 and HE^fcHj? < 84. Therefore, combining this with the definition of /i3, 
(|3T3]1 follows. D 

Lemma 3.10 ( J14j). There exist two positive numbers 5^ and oji such that, for any orthogonal 
matrix P with \\P — Q{c*)\\ < 65, the skew- symmetric X defined by e-^ := P~^Q{c*) satisfies 

\\X\\ <u;i||P-Q(c*)||. 

Based on Lemma 13.101 by using the similar arguments in the proof of [1E\ Lemma 3.4], we 
can obtain the following lemma. If we write e *= := PJQ*, then there exists C > such that 

linii<c(i|c'=+i-c*ii + iix,ii). 

Lemma 3.11. Suppose that the given eigenvalues {X*}f^i are distinct and the Jacobian matrix 
J(c*) is invertible. Then, there exist a;2 > and < Jg < iTLinj^s, -rnr — tt;} such that, for k 
sufficiently large, if ||c "''"'^ ~ c*|| < 6q and \\Ek\\ < 6e, then 

\\Ek+i\\<U2{\\c''+'-c*\\ + \\Ekf), 

where uji is determined by Lemma \3. 10[ 

In order to prove our global convergence result for Algorithm 12. H we introduce some notations. 
Let Ci := ^(^^^^^ and C2 := 2M(/X3 + C?). Set 

r := min |l, (2M(^3 + C^)y~" , ico2iC2 + 1))"^} , (3.14) 

(5 :=min{r, (52,53,'^4,'^6}- (3.15) 

Our main global convergence result is as follows. 

Theorem 3.1. Assume that {c*^} is generated by Alaorithm \2.1[ Suppose that the given eigenvalues 
{X*}^^i are distinct and c* is an accumulation point of {c } such that J(c*) is invertible. Then, 
p{c^) — A* — )■ and c'^ — )■ c* as k ^ 00. Moreover, the convergence is of R-order j3. 

Proof. It follows immediately from Corollaries 13.21 and 13.31 that p(c ) — A* — t- and c — t- c* as 

/c — 7- 00. For the r given in ()3.14p . there exists /cq sufficiently large such that Hc'^" — c*|| < r and 
ll-E'fcoll ^ ''"■ Set 7 := (5/r, where 5 and r are given in ()3.15p and ()3.14p . respectively. Then, 7 < 1. 
We will show that, for all k > ko sufficiently large, 

||c'=-c*||<r•7/^'-'^ (3.16) 

m\\<T.j^'-"\ (3.17) 

Suppose that (|3.16p and (j3.17p hold for some k = I > k^. Consider the case k = £ + 1. Thanks to 
Lemma 13.21 we have, for all i > ko, 



|p(J)-A*|| <^/^L\\c^-c*\\+^i2\\Ee\ 
< ynLr ■ Y + ^^2^ ■ T 
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= iV^L + fi2)r ■ j^ ~ \ (3.18) 

Then, by using Lemma 13.9^ one has that, for all i > ko, 

||c^+i - c*|| < 2M U3\\Ee\\l + (^) IIp(c^) - A*|| J 






< 2M 



^3 + 



< TJ' 






« Ri-ko + 1 



where the last inequality follows from the definition of r in (j3.14p . By Lemma I3.1H we have, for 
all I > /co, 

< 2Ma.2(/x3 + Cf )r^^'~'=°^^ + u^^r^ (7/^^-'=°)' 

< a.(2M(^3 + Cf ) + IV ■ l^'-"'"' 
= a;2(C2 + Ijr'' •7'' 

< r • 7^ 

Therefore, we conclude that (|3.16p and (j3.17p hold for all k > ko. Moreover, we see from (|3.16p 
that c converges to c* with R-order /3. This completes the proof. D 

If {c } generated by Algorithm 12.11 converges to a solution at which the Jacobian matrix is 
invertible, then the ultimate rate of convergence is governed by the choices of the %(A: = 0, 1, . . .) 
as in the local theory of [1]. 

4 A Modified Global Inexact Newton-Type Method 

We observe from Lemmas 13.41 and 13.51 that, when the Jacobian matrix J^ is invertible, the 
condition (|3.4p holds for some Ac , and so the backtracking loop terminates after a finite number 
of steps. Comparing the condition (|3.4p with the condition in the while loop, that is: 



||p(c^- + Ac'^) - A*|| < (1 - e(l - %))||p(c^') - A*||, 

one finds that the condition p.4p is more feasible in practice. To improve the practical effectiveness 
of Algorithm 12. H we give a modified algorithm as follows. 

In our numerical examples, we will report the numerical performance of Algorithm 14.11 instead 
of Algorithm 12. 1^ since Algorithm 14.11 is more effective and feasible in practice. 

5 Numerical Examples 

In this section, we illustrate the effectiveness of Algorithm 14. 1 1 for solving lEP on two examples. 
The tests were carried out in MATLAB 7.0. 
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Algorithm 4.1: Modified Inexact Newton Backtracking Cayley Transform Method for lEP 

For any c'' S IR",??max £ [0, 1),C ^ (0, 1),0 < 9min < Smax < 1- Compute the orthonormal 
eigenvectors {qj(c°)}"^^ and the eigenvalues {Aj(c°)}"^^ of A(c''). Let Pq and p{c^) be 
defined in (|2.10p and (|2.1ip . respectively. For A; = 0, 1, 2, . . . until convergence do: 

step 1. Form [Jk]ij = Pi{c^) ^jPi(c'^) for I <i,j < n. 

step 2. If Jfc is singular, perform the same steps as in Algorithm 12 .H else perform 

step 2.1. Solve (I2.12p for Ac^ such that condition (I2.13P is satisfied. 

step 2.2. Set Ffc := Mk j"^!''""'' , where M^ := 11 Jr^ll. Perform the backtracking loop: 

-L /^/max II ft, II (^ J. 

while IIAc'^ll > Fkil - Tik)\\p(c^) - A*|| do: 



choose 6 G [^minj^max]) then update Ac 
step 2.3. The same as step 7 in Algorithm 12.11 



6'Ac''' and 77^ ^ 1 - 6'(1 - %). 



= 0.1 and 

A* II if 80 



The given parameters used in our algorithm were rjo = 0.5, rymax = 0.9, ^ = 10"^, ^min 
^max = 0.9. In the while loop, we choose 6 G [^mim ^max] to minimize ||p(c'^ + 6/S.c^) - 
iterations of the backtracking loop fail to produce the sufficient decrease in ||p(c) — A*||. 

Linear systems (j2.9p and (|2.12p are all solved iteratively by the QMR method [13] using the 
MATLAB qmr function. In order to guarantee the orthogonality of P"'^"" in ()2.9|) . this system is 
solved up to mathine precision eps (~ 2.2 x 10^^^). The stopping tolerances for system (j2.12p is 
given as in ()2.14p . The inner loop stopping tolerance for ()2.12p is given by (12. lip . The stopping 
criterion of the outer iteration in our algorithm is 



|P/A(c^)Pfc-A,||i.<10- 
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(5.1) 



EXAMPLE 1. This is an inverse Toeplitz eigenvalue problem (see |20j for more detail on this 
inverse problem) with distinct eigenvalues. The basis matrices {^j}?^^ ^-^^^ given as follows: 



A, 



10 







1 










00100 


10 







1 


1 







00010 


10 





, A2 = 


1 





1 


, ^3 = 


10001 


1 










1 


1 




01000 





1 _ 




. 





1 _ 




00100 


r 1 


1 




r 





1 1 




0000 


1 















0000 





, A = 













1000 


















0100 


_ 




1 













Ai 



The given real eigenvalues and a solution, respectively, are 

A* = 
In Table [H we report our numerical results for various starting points: 

(a) c° = (1,2,3,4,5)^; (b) c° = (1, 5, 10, 15, 20)^; (c) c° = (11, 12, 13, 14, 15) 



5.2361,-1.5876,-0.7639,-0.5555,18.1431)"^ and c* = (2, 3,4, 5,6)"^. 
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c^ 




/3 = 1.5 


/3 = 1.8 




/3 = 2.0 


(a) 


errs 


1.0659e-02 


1.0659e-02 




1.0659e-02 






1.1323e-05 


1.1323e-05 




1.1323e-05 






8.0567e-12 


8.0567e-12 




8.0567e-12 




ite. 


6 


6 




6 




c* 


(2.0000, 3.2926, 3.4471, 4.9014, 6 


5529)^ 




(b) 


errs 


3.8846e-03 


3.8846e-03 




3.8846e-03 






1.2491e-06 


1.2491e-06 




1.2491e-06 






7.9990e-14 


7.9990e-14 




7.9990e-14 




ite. 


9 


9 




9 




c* 


(2, 3, 4, 5, 6) "^ 








(c) 


errs 


5.0389e-05 


5.0389e-05 




5.0389e-05 






3.5838e-10 


3.5838e-10 




3.5838e-10 






5.0337e-15 


5.0337e-15 




5.0337e-15 




ite. 


13 


13 




13 




c* 


(2.0000, 3.2926, 3.4471, 4.9014, 6 


5529)^ 




(d) 


errs 


1.3806e-04 


1.3806e-04 




1.3806e-04 






6.4118e-09 


6.4118e-09 




6.4118e-09 






9.8493e-15 


9.8493e-15 




9.8493e-15 




ite. 


75 


75 




75 




c* 


(2.0000, 3.2926, 3.4471, 4.9014, 6 


5529)^ 




(e) 


errs 


1.2028e-04 


7.7624e-03 




7.76246-03 






3.8608e-10 


6.1243e-06 




6.1243e-06 






5.3680e-15 


2.1634e-12 




2.1634e-12 




ite. 


13 


5 




5 




c* 


(2,3,4,5,6)^ 









Table 1: Numerical results for Example 1. 



(d) c° = (21,38,46,63,81)^; (e) c° = (101, 112, 123, 134, 145) 



where c'^, errs, ite. and c* stand for the starting point, the error value of the left hand side of (|5.ip 
for the last three iterates of the algorithm, the number of outer iteration and the accumulation 
point corresponding to the starting point. 

EXAMPLE 2. This is a Toeplitz-plus-Hankel inverse eigenvalue problem (see [IQl for more 
details on this inverse problem) with distinct eigenvalues. The basis matrices {Ai}J^^ are given as 
follows: 



A, 



-10 

10 

10 

10 

10 

10 

1 



Ao 



0-100000 

-1 10 

10 10 

10 10 

10 10 

10 1 

10 



15 



A. 



A. 



A. 









-1 








" 



















-1 





" 









-2 





1 


















-2 





1 









1 








1 















-2 











1 









1 








1 





? 


^4 = 


-1 














1 


; 










1 








1 









1 



























1 


















1 
























1 





. 















1 





. 


















-1 


" 




- 














- 


-1 


" 











-2 





1 


















-2 





1 








-2 








1 















-2 














-2 














, Aq = 







- 


-2 














1 





















- 


-2 




















1 


















-1 


























1 








_ 









1 














_ 

















- 


-1 " 

































-2 

































-2 

































-2 

































-2 

































-2 

































1 














c 




. 























The given real eigenvalues are 

A* = (-35.4513, -13.6805, -9.5675, -8.5489, 8.7666, 11.8220, 20.6596)"^, 

and c* = (2, 3, 4, 5, 6, 7, 8) is a solution. In Table [H we report our numerical results for various 
starting points: 

(a) cO = (1,2,3,4,5,6,7)^; (b) c^ = (1,3, 5, 7, 9, 11, 13)^; 

(c) c° = (11,13, 15, 17, 19,21,23)^; (d) c° = (50, 52, 56, 58, 62, 65, 68)"^; 

(e) c° = (101, 102, 103, 104, 106, 108, 110)^. 

We observe from Tables 1 and 2 that our algorithm is convergent for different starting points. 
We also see that our algorithm converges to a solution of the lEP, which is not necessarily equal 
to the original one. 
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c^ 




/? = 1.5 


13 = 1.8 


13 = 2.0 


(a) 


errs 


8.2730e-03 


8.2730e-03 


8.2730e-03 






2.2866e-05 


2.2866e-05 


2.2866e-05 






5.5845e-ll 


5.5845e-ll 


5.5845e-ll 




ite. 


6 


6 


6 




c* 


(2,3,4,5,6, 
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7 
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